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In this paper, an optimization approach, which is based on the Bayesian Linear 
Inference (BLI) model, has been proposed for the maintenance of 
Programmable Logic Controllers (PLCs). The BLI model, which is implemented 
using historical data, incorporates maintenance indicators like the number of 
failures (NF), total downtime (TD), total unexpected intervals (TUI), mean time 
to repair (MTTR) and mean time between failures (MTBF). It offers a 
probabilistic framework for determining the influence of each predictor 
variable on PLC maintenance. The model produces posterior means, credible 
intervals, and standard deviations, which provide insights into the magnitude 
and uncertainty of these relationships. The results from the study show that 
factors like NF and TD are influenced by the magnitude and direction of the 
maintenance levels. Also, the R-squared score (0.85) also indicates how much 
of the variability in maintenance in the system. From the results obtained, the 
study can conclude that the BLI model can optimize PLC maintenance 
procedures by identifying essential components and their contributions. Also, 
itis able to estimate future maintenance requirements and helps with resource 
allocation and process optimization decisions. 


1. Introduction 


Programmable logic controllers (PLCs), which are 


system information, an objective function, and an 
optimization technique. Wang [5] created a general 
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essential components of industrial automation systems, are 
used in manufacturing settings to manage and monitor a 
variety of operations. For PLCs, effective maintenance 
procedures are critical to ensuring their longevity and 
reliability. Although several authors have proposed and 
developed models for the management of maintenance, 
longevity, and reliability of the PLC systems [1- 5]; however, 
there are still limited studies, on the specific subjects of 
maintenance optimization for PLC systems. Through typical 
maintenance optimization, organizations can reduce the 
probability of unexpected failures, such that they can reduce 
the amount of downtime and increase productivity. Also, they 
will be able to guarantee that PLC systems run at optimal 
efficiency with the lowest failure risk by optimizing 
maintenance schedules based on criteria such as equipment 
usage, operational conditions, and historical performance 
data. This method bridges the gap between academic 
research and the practical application of maintenance 
optimization models. Dekker [6] described his perception of 
an optimization model as representing a technical system, its 
function and importance, system deterioration, available 


framework for optimizing maintenance policies, system 
configuration, maintenance effectiveness, maintenance cost, 
optimization criteria, modeling tools, planning horizon, 
reliability, and system information which are used as inputs 
for the framework. According to Marais & Saleh [7], different 
optimization models can be obtained by changing the system 
configuration, maintenance effectiveness, planning horizon, 
analytical tools, and component dependencies. Although this 
provides a good idea for building a maintenance optimization 
model; however, it does not include all of the optimization 
classes. Optimization classes are the input parameters 
required to build a maintenance optimization model, which is 
expected to produce the desired output. While most 
optimization models adopt a component perspective, Tan & 
Raghavan [8] developed a framework for a predictive 
maintenance-based plan generated from a system 
perspective. Wang [5] and Nicolai & Dekker [3] considered 
the planning horizon when categorizing the different 
optimization methods where they were classified into models 
for finite periods; however, they didn't consider the 
exploration of maintenance optimization. Using the Markov 
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analysis method, Alizadeh & Sriramula [9] and Liu & 
Frangopol [10] presented a novel reliability model for 
redundant safety-related systems. Providing a logical 
reliability assessment of ship structures under various 
threats throughout their lifecycle. A flexible set of modeling 
patterns was presented by Meng et al. [11] and implemented 
in the Alta-Rica 3.0 language. Chen & Mehrabani [12] 
introduced a technique for analyzing the reliability of coastal 
flood defenses, such as earth sea dykes, about changing 
operating conditions. The method also included future 
performance projections and the best maintenance plan. A 
unique approach to reliability-centered maintenance based 
on artificial neural networks was introduced by Pliego 
Marugan et al. [13]. Zhu et al. [14] presented and examined a 
reliability and maintenance model of a k-out-of-n: F system 
for PLCs. During this process, the system underwent a 
rebuilding process with reduced performance, which was 
followed by preventive maintenance (PM) with the 
replacement of malfunctioning components. During this 
rebuilding process, the system was susceptible to failure with 
various failure criteria. Izquierdo et al. [15] proposed a novel 
strategy that used a case study approach to validate it, which 
helped to reduce the uncertainty arising from the operational 
context. A condition-based maintenance decision framework 
for a multi-component system subject to a system reliability 
requirement was created by Shi et al. [16]. Ma et al. [17] 
looked into the methodologies for maintenance optimization 
and reliability analysis of a two-unit warm standby cooling 
system. A performance-balanced system operating in a shock 
environment was proposed by Wang et al. [18], which is 
hardly observed in the literature. The joint optimization of lot 
sizing and maintenance policy for a multi-product production 
system subject to two failure scenarios was studied by Gao et 
al. [19]. Chang et al. [20] applied the approach of minimal cuts 
for demand d (d-MC) to evaluate the time-related reliability 
of a multi-state flow network (MSFN). 

To address the maintenance optimization issue of the 
PLCs system, a Bayesian Linear Inference (BLI) model has 
been proposed in this study. The BLI is a potent statistical 
method that maximizes maintenance strategies by utilizing 
both linear modeling and Bayesian principles. Using the BLI 
model to schedule and carry out maintenance for PLC systems 
transforms the process and results in lower costs, downtime, 
and an increase in the system’s reliability. With the BLI model, 
the study will be able to take into account system variability 
and uncertainties, which are common within the complex and 
dynamic environments in which PLCs operate. This model is 
especially useful as it is possible to accurately estimate future 
maintenance requirements by simulating the interactions 
between the many elements that characterize the PLCs 
system performance. Maintenance workers can make well- 
informed decisions and judgments using these approaches, 
which offer a probabilistic framework based on the likelihood 
of various outcomes and for handling the inherent 
uncertainties in PLC's behavior, such as wear and tear, 
weather conditions, and component deterioration. 


2. Bayesian linear inference model 

The Bayesian Linear Inference model is a probabilistic 
version of the linear regression that applies the Bayesian 
principles. It represents a framework for the estimation of the 
parameters of a linear regression model taking into account 
the uncertainty, and allowing for re-use of previous 
experience. It is a powerful agent in incorporating past 
knowledge of the parameters. This is most beneficial in cases 
where such information about the variables or parameters is 
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available previously. Uncertainty in parameter estimations is 
captured in it. Rather than providing point estimates of 
regression coefficients and error variance, the model 
generates posterior distributions that represent the range of 
feasible values for the parameters in light of the observed 
data and previous knowledge. The governing equations of the 
model have been presented in the following definitions. 


3. Definition 

Let the prior distribution of 0 be given as a normal 
distribution N(u,2) where p is the mean and can also be 
referred to as the first moment and be the covariance matrix 
and the second moment of the distribution, such that the 
probability of 0 is given as: 


P(8) = zexp[- 5 (0 - "z^ (6 - w)} (1) 
where 
u=Epxo lð] and Z= Epo [CO — 1)" (0 — 1] 


Equation (1) is the governing equation of the BLI model, and 
it refers to the moment parametrization of 0 since it consists 
of the first moment (u) and the second moment (£) of the 
variable. Z is a normalization factor with the value 


J/ Q1)" det (2), where; is the dimension of 0. To prove this 
equation, one can translate the distribution from the origin 
and do a change of variables such that the distribution has the 
form and can be expressed 0' in polar coordinates and 
integrate over the space to compute Z. 


P(8*) =z exp {-+9'70'} (2) 


With the BLI model, it is possible to determine the probability 
of an output y;4, given a new input x;4, and the set of data 
D = {(@%, yi}; =1,--,t. To compute the probability 
P(Yt+1lXt+1, D), the distribution@is introduced into this 
expression and marginalize over it. 


PO au D) = foco POM 60,D)P(60|x..,,D) (3) 


D explains no more than what 0 does, P(y;,4|x;,,, 0, D) is 
essentially P (yt+1|Xt+1, 8, ). Also, from the graphical model 
the study can determineP(60 |x;, D)is P(@|D) since y; is known 
and thus 0 andx; are independent, hence, Equation (3) can be 
rewritten as: 


POt+1lXt+1 D) = Joan POt+ilXt+1, 8) P(@|D) (4) 


However, computing with the above equation may be too 
complex due the moment parameterization of normal 
distributions(0) but not with the natural parameterization. 
Hence, the moment parameterization of normal 
distributions(0) is converted to natural parameterization of 


normal distributions in the form P(x) = zexp (^ie — 


u)Tx(x- 1) which can also be expressed further as: 


P(x) = Z exp Ux — 5x" Px} (5) 


The natural parameterization simplifies the multiplication of 
normal distributions as it becomes the addition of the J and P 
matrices of different distributions. Transforming the moment 
parameterization to the natural parameterizationis done by 
first expanding the exponent: 


= ; (x—-uyx!x-u)-- zxTy-i tr xe ETUR 
(6) 


AF. Obele et al. /Future Technology 


The last term in the above equation, has nothing to do with x 
and can therefore be absorbed into the normalizer, by 
comparing equations (5) and (6), J and Ptherefore can be 
expressed as: 


J-r'!u 
b Lp 7) 


where the matrix P is called the precision matrix. 


4. Posterior distribution P(0|D) 
Using Bayes rule, the posterior probability P(0|D)can be 
expressed as 


P(0|D) x P(Y1:tlx1:t9)P (0) « (ier PO bx, 0)) PCO) 
(8) 


The y;'s and 0 have a diverging relationship at 0, and since 0 
is unknown, it follows that the y;'s are independent of each 
other; that is, P(y1:tlX1:t 0) = I4 P(y1lx1,0). An easy 
updating rule can compute this product. By examining the 
result ofP (y, |x, 0) P(0). 


PG ba, 0)P(8) x exp f- Qi — 6" x)?} exp {J — 
+9" po) « exp {- zz (-2y,07 x; + 0" xix 6)) exp Ure — 
20" po) = exp {=yix"@ - zz 0 xxT6] exp Ure - 
z0" po) = exp {( + ly) 0— 5a" (P + + xix!) ej 
= exp Ue - = 0" Pa} 


whereP(y,|x1,0) is the likelihood function and P(@) is the 
prior distribution. The equation was broken down to 
understand the components of the posterior distribution as. 


i Plx, )P(0) « exp f- Z5 i — 07x)? exp? — 


+" po) 


This step involves multiplying the likelihood function 
P(yilx1,0) and the prior distribution P(@) together. The 
likelihood function represents the probability of observing 
the data y, given the parameters Qand xı. The prior 
distribution represents our initial beliefs about the 
distribution of 0 before observing any data. 

ii oc exp [zs C29 x; 4 0" x;x? 6)) exp Ure — =" P0) 
In this step, the quadratic term was expanded in the 
exponential and the expression was simplified. The terms 
were combined with 0 to form a quadratic form. 


iii exp {=yix"@ — =O" xix} exp Ure — =" po) 


Here, the terms were collected with 0 to rewrite the 
expression. 


iv. «exp Ue — =0" Pa} 


Finally, the terms involving Owere combined, resulting in the 
desired form. /' and P' represent new vectors or matrices 
obtained from the original terms, depending on the values of 
J, P, yj, xj, and ø respectively. 

The resulting expression is proportional to the exponential of 
a quadratic form in 0. This form is typical in Bayesian 
inference, where the posterior distribution is often 
proportional to the exponential ofa quadratic form due to the 
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conjugacy of certain prior and likelihood combinations. Line 
1 to line 2 is true because any term that does not have 0 can 
be absorbed into the normalizer. Now, we can apply the 
generalized result to Equation (8) and derivethe following: 


PED) x expf( +225) 0 -10r (p +2) — (9 


where, P(0|D) is a normal distribution with J ring, = J - ^—-— xxt 


Eod 


and Prinal = = P +4 1 


normal debuton. and as the number of x; increases, the 
terms in this matrix become larger. Also, since Pring; is the 
inverse of the covariance, the variance gets lower as the 
number of samples grows. This is a characteristic of a 
Gaussian model that a new data point always lowers the 
variance, but this downgrading of variance does not always 
make sense. If we believe that there are outliers in our 
dataset, this model will not work. With the relation previously 
given, the mean and covariance of this distribution may be 
determined: 


- Pfinaiis the precision matrix of the 


1 
SUUM Yiyixi 


c? 


HB final = pa 22 


T -1 
Xfinal = = pr T Bixi Zinai) 

where, fing: is the mean of the distribution and Xj; is the 
covariance of the distribution. 

Lginat and Xfinaı are broken down as: 


1 
Eee) Yiyixi 


c? 


HB final = pa + 


In this Equation, X represents the covariance matrix and X^! 
denotes its inverse. The term (Y; xix] ) represents the sum of 
the outer products of the input vectors xj. ois the standard 
deviation or noise parameter. The expression (XYi;yixi) 
represents the sum of the product of the observed target 
values y; and the corresponding input vectors x;. The 
expression calculates the updated value of the mean 
parameter Hfinar. It involves matrix computations where the 
inverse of the covariance matrix X is added to the sum of the 
outer products (Y; x;x7 ). This sum of outer products captures 
the structure of the input data. The term (Y; yjx;) is multiplied 
by the inverse of the noise parameter o?. 


i. Spina = (27? + zian) 


Here, the expression calculates the updated value of the 
covariance matrix Zing. It involves a similar matrix 
computation as in the previous Equation. The inverse of the 
covariance matrix X^! is added to the sum of the outer 
products (Y; x;x/), capturing the structure of the input data. 
This sum is then inverted to obtain the updated covariance 
matrix Xrina;. 

These Equations are used in BLI to update the mean and 
covariance of the posterior distribution of the parameters. 
They incorporate the observed data and provide a way to 
update the prior beliefs based on the likelihood of the data 
and the noise parameter o. 


-1 


5. Probability distribution of the prediction 

The next step is to compute the probability distribution 
of predictionP (yt+1|Xt+1, 0). Since the linear combination of 
normal distributions is also a normal distribution, 
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P(Yt+1|Xt+1, 9)therefore the distribution can be written in the 


form zexp {- zz a E Hsc) Eyelid E jaa) where 


By, = Elyeal = E[O7 x41 +€] = E[07 X41] + Ele] = 
E[O\" X41 +0 = Wp Xe41 


and 


= T 2 
Eya = Xt41 ZoXt+1 +O 


The components are broken down and explained as: 


i. POt+1lXt+1 8) = Z exp [za z Hya) Zya Oe E 
lys) 


This equation represents the conditional probability 
distribution of the target variable y,,, given the input 
variable x,,4 and the parameter 0. It is characterized by a 
multivariate Gaussian distribution. 


ii. Uy... = Elves] = E[07 xc44 + €] = E[07 X41] + Ele] 
= E[O]" X41 + 0 = Hg Xt 


In this expression, Uy, represents the mean of the target 
variable y;44. It is calculated by taking the expected value of 
07 x,,, and considering that the expected value of the noise 
term e is zero. Thus, the mean of y,,, is given by the dot 
product of the expected value of 0 (denoted as ug) and the 
input variable x; 4. 

iii. X 


= T 2 
‘Yeu. — Xt+1 XEgxi.i +O 


Here, Z,,,, represents the covariance matrix of the target 
variable y;,,. It is calculated by taking the outer product of 
Xt+1 and Xg (the covariance matrix of 0) and adding the 
variance o?. The expression captures the uncertainty in the 
target variable y,,, based on the uncertainty in the parameter 
0 (represented by X) and the noise level ø. In addition, the 
equation defines the conditional probability distribution of 
yt41 given xc4,4 and 0 as a multivariate Gaussian distribution, 
characterized by the mean py,,, and covariance matrix Xy, .. 
These parameters depend on the expected value of 0 (ug), the 
input variable x;44, and the covariance matrix of 0 (2g), as 
well as the noise level c. 


6. Application of the model, results and discussions 
The summary output of the BLI model offers details on 
credible intervals, the posterior distribution of the 
coefficients, and other pertinent statistics. BLI yields a 
distribution for every coefficient rather than point estimates. 
The range of values that a coefficient is most likely to fall into 
with a given probability is represented by credible intervals. 
The linear regression model's details, such as coefficients, p- 
values, R-squared, etc., are shown in the summary output. A 
coefficient shows how each predictor, and the dependent 
variable are related to one another. The importance of every 
prediction is shown by the P-value. Indicators of statistical 
significance have a low p-value (« 0.05). Alongside the fitted 
linear regression line are the real data points in this graphic. 
Due to the dependent variable's linear relationship to the 
predictors, the anticipated values are shown by the linear 
regression line. The places where the model might not fit well 
are indicated by data points deviating from the line. The 
distribution of residuals, or the disparities between actual 
and expected values, is displayed in the residuals plot. The 
residuals should ideally be dispersed randomly at about zero. 
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3.1 PLC maintenance 

Number of Failures, or NF: Understanding the correlation 
between the number of failures and the months can be aided 
by linear regression. The NF plot has a positive relationship; 
although the data point have a good fit with the regression 
line. The data point suggests that failure rates have increased 
in the last few months. Residual plot exhibit a normal 
distribution with a negative (-ve) intercept at the y-axis. 
Mean time to repair (MTTR): The MTTR plot has a positive 
relationship, with the data point having a good fit with the 
regression line. The data point suggests that failure rates have 
decreased in the last few months. Residual plot exhibit a 
normal distribution with a positive (+ve) intercept at the y- 
axis. 
Total Downtime (TD): The TD plot has a positive relationship, 
with the data point having a good fit with the regression line. 
The data point suggests that failure rates have decreased in 
the last few months. Residual plot exhibit a normal 
distribution with a negative (-ve) intercept at the y-axis. 
Total Unscheduled Incidents (TUI): The TUI plot has a 
negative relationship, with the data point having a good fit 
with the regression line. The data point suggests that failure 
rates have decreased in the last few months. Residual plot 
exhibit a normal distribution with a negative (-ve) intercept 
atthe y-axis. 
Mean time before failure (MTBF): The MTBF plot has a 
negative relationship, with the data point having a good fit 
with the regression line. The data point suggests that failure 
rates have decreased in the last few months. Residual plot 
exhibit a normal distribution with a positive (+ve) intercept 
atthe y-axis. 
Generally, the relationship between the predictor variables 
(NF, TD, TUI, MTTR, and MTBF) is revealed by the results 
from the implementation of the BLI model. A more detailed 
explanation of the essential elements and data used in the 
model are summary as follows: 
a. The initial maintenance value is from January when all 
predictors are 0.0 and a 9596 credible interval ([145.5, 
154.9]) which indicates that the true value of the intercept is 
most likely located within this range about 9596 of the time. 
b. The modest p-value is «0.001, it is concluded that there is a 
significant difference between the intercept and zero. SD 
(2.1): The degree of fluctuation or uncertainty surrounding 
the estimate. NF (Number of Failures): A rise in failures of one 
unit is correlated with a rise in maintenance of 3.5 units. [2.8, 
4.2] is the 9596 credible interval for NF.SD (0.6): The 
estimate's level of uncertainty. Given the modest p-value 
(<0.001), a significant positive connection is implied. 
TD (Total Downtime): There is a -1.2 unit drop in 
maintenance for every unit rise in total downtime. Lower 
maintenance appears to be linked to increased total 
downtime, as indicated by the negative coefficient. [-1.7, -0.7] 
is the 9596 credible interval for TD. There is a substantial 
negative association, as indicated by the p-value of 0.012. 
Similar interpretations as NF and TD apply to TUI (Total 
Unexpected Intervals), MTTR (Mean Time to Repair), and 
MTBF (Mean Time Between Failures). R-squared: With an R- 
squared of 0.85, the model accounts for 8596 of the variation 
in the maintenance measures. This gives a very good 
regression performance. In conclusion, estimates of each 
predictor's influence on PLC maintenance are provided by the 
Bayesian linear regression model, coupled with an 
explanation of the uncertainties surrounding these values 
(Table 1). It gives an indication of the factors that are highly 
correlated with maintenance and a gauge of how well the 


11 


AF. Obele et al. /Future Technology August 2024] Volume 03 | Issue 03 | Pages 08-14 


model matches the data. These observations can be helpful in 


Linear Regression for TUI 


maximizing PLC's general maintenance plans (Figures 1-5). BS 
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Figure 3. Linear regression plot of total downtime 
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7. Conclusion 

The use of Bayesian linear regression to optimize the 
overall maintenance of Programmable Logic Controllers 
(PLCs) is a valuable and insightful method. The resulting 
plots, which demonstrate the correlations between key 
maintenance indicators and overall maintenance levels, are a 
visual depiction of the model's predictions and uncertainty. 
The Bayesian linear regression model, with its posterior 
means, credible intervals, and standard deviations, allows for 
a more nuanced understanding of the impact of variables like 
the number of failures (NF), total downtime (TD), total 
unexpected intervals (TUI), mean time to repair (MTTR), and 
mean time between failures (MTBF) on PLC maintenance. 
These insights enable stakeholders to identify crucial factors 
impacting maintenance levels and make sound decisions 
about resource allocation and process improvement. The R- 
squared values, which indicate the model's explanatory 
power, show what percentage of variability in maintenance 
the model explains. This fit value gives confidence that the 
model can reflect the complexity of the predictor- 
maintenance connection. Furthermore, the provided 
Bayesian linear regression model provides a probabilistic 
framework that takes into account uncertainty in parameter 
estimations, which improves its robustness in real-world 
applications. This functionality is especially important in the 
dynamic and frequently unpredictable industrial settings 
where PLCs operate. The application of Bayesian linear 
regression to optimize PLC maintenance demonstrates a 
thorough and adaptable methodology. This approach, which 
uses historical data and probabilistic modelling, provides a 
valuable tool for not just anticipating future maintenance 
requirements, but also strategically improving overall system 
reliability and efficiency. The plots and findings show that 
Bayesian inference has the potential to be a valuable tool in 
the optimization and decision-making processes of PLC 
maintenance. 
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